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(57) A CPU controls a graphic controller based on 
control programs within a main RAM to extract a series 
of rhythm sound data for each of multiple mimic percus- 
sion .nstruments from a graphic RAM and correlates 
these in a time-axial direction for display on a monitor 
instruction and display of the operating timing for each 
sound of the multiple mimic percussion instruments is 
performed on the monitor, the player performs sequen- 
tial striking input with the left and right hands for exam- 
ple for the rhythm sounds via the rhythm input detecting 
means corresponding to multiple mimic percussion 
instruments, while confirming the operation timing dis- 
play instructions thereof, the timing thereof is compared 
with the timing of the display instruction and evaluation 
is made based on the offset thereof, and the evaluation 
results are accumulated. Thus, a rhythm-matching 
game with a high gaming nature is realized, by inputting 
operation for multiple instruments using multiple hands 
and feet such as the left and right hands 
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Description 



[0001] The present invention relates to a music 
staging game apparatus such as a rhythm game appa- 
ratus for performing a musical rhythm-matchino game 5 
and a music staging game method, and a readable stor- 
age medium wherein a music staging game program 
thereof is stored. 

[0002] Conventionally, there are game systems 
wherein sounds are matched in rhythm with background 10 
music (Back Ground Music), or wherein a short playing 
• around one phrase or so is added and played. 
[0003] Also, guitar game apparatus which gener- 
ates a cardiogram-like rhythm, which performs rhythm 
matching while watching a cardiogram-like rhythm, has 75 
been proposed (refer to Japanese Patent National Pub- 
lication No. 8-510849). 

[0004] However, with rhythm-matching such as the 
above-described conventional guitar game apparatus, 
operation was performed to one instrument, but this was 20 
not a rhythm-matching game performed in a state closer 
to reality where a player uses the a plurality of the right 
hand and left hand and further the right foot and left foot 
such as the right and left hands for example, for multiple 
percussion instruments, as with an actual instrument, 25 
and thus did not have a high game-nature. 
[0005] The present invention has been made in 
order to solve the above conventional problems, and it is 
an object thereof to provide a music staging game 
apparatus, music staging game method, and a readable 30 
storage medium thereof capable of realizing a rhythm- 
matching game with a high game-nature by performing 
striking operations using multiple of such as the right 
and left hands, for example. 

[0006] The music staging game apparatus accord- 35 
mg to the present invention comprises: a plurality of 
staging operating means for staging input from a player 
by at least a striking operation; a storage means for stor- 
ing data regarding music and staging means for the 
music; a playing means for playing the music based on 40 
the storage contents of the storage means; a staging 
operation instructing means for visually instructing the 
player in the staging operating using the staging operat- 
ing means, following the storage contents of the storage 
means in a manner synchronous with the progression of 45 
the playing by the playing means; a staging effects gen- 
erating means for generating staging effects corre- 
sponding to the staging operation; an evaluating means 
for evaluating the staging operation based on the corre- 
lation between the staging procedures stored by the 50 
storage means and the staging operation made by the 
player; and evaluation display means for displaying 
information according to the evaluation results of the 
evaluating means to the player. 

[0007] According to the above configuration, the 55 
staging operation using multiple staging operating 
means for staging input by the player comprised of at 
least a striking operation is visually displayed and 



instructed to the player following the stored contents of 
the storage means, and sequential striking input is per- 
formed with the left and right hands for example for 
staging of music corresponding to multiple staging oper- 
ating means, while confirming the operation timing dis- 
play instructions of the striking operation at least, so a 
music staging game with higher gaming nature is real- 
ized, and also, even though staging operation for music 
is performed in a percussion instrument playing state 
closer to reality using at least the right hand and left 
hand, operating for the music staging is performed 
based on visual display instructions, so the complexity 
of the music staging game is lightened, and can be car- 
ried out relatively easily. 

Fig. 1 is a block diagram illustrating the control con- 
figuration of the rhythm game apparatus according 
to an embodiment of the present invention; 
Fig. 2 is an external perspective view of the rhythm 
game apparatus shown in Fig. 1 ; 
Fig. 3A is a plan view illustrating a variation of the 
drum pad shown in Fig. 2 

Fig. 3B is a cross-section view along line IIIB in Fig. 
3A. ; 

Fig. 4 is a plan view of the foot pedal shown in Fia 
2; 

Fig. 5 is a cross-section view along line V-V in Fig. 

Fig. 6 is a block diagram illustrating the control con- 
figuration of the rhythm game device shown in Fia 
2; " y * 

Fig. 7 is a diagram illustrating an example of the 
game screen displayed on the monitor shown in 
Fig. 6; 

Fig. 8 is a diagram illustrating another example of 
the game screen displayed on the monitor shown in 
Fig. 6; 

Fig. 9 is a diagram illustrating an example of the 
warning screen displayed on the monitor shown in 
Fig. 6; 

Fig. 10 is a diagram illustrating an example of the 
normal mode having been selected in the mode 
selection screen displayed on the monitor shown in 
Fig- 6; 

Fig. 11 is a diagram illustrating an example of the 
practice mode having been selected in the mode 
selection screen displayed on the monitor shown in 
Fig. 6: 

Fig. 12 is a diagram illustrating an example of the 
real mode having been selected in the mode selec- 
tion screen displayed on the monitor shown in Fia 
6; y " 
Fig. 13 is a diagram illustrating an example of the 
sound selection screen displayed on the monitor 
shown in Fig. 6; 

Fig. 14 is a diagram illustrating another example of 
the sound selection screen displayed on the moni- 
tor shown in Fig. 6; 
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Fig. 15 is a diagram illustrating an example of the 
miss screen displayed on the monitor shown in Fia 
6; 

Fig. 16 is a diagram illustrating an example of the 
grades display screen displayed on the monitor s 
shown in Fig. 6; 

Fig. 17 is a notes display diagram for explaining the 
stepped evaluation regarding timing offset for the 
striking or pedal operation as to the notes bar; 
Fig. 1 8 is a flowchart illustrating the operation of the w 
rhythm game apparatus shown in Fig. 1; 
Fig. 19 is a diagram illustrating yet another example 
of the game screen displayed on the monitor shown 
in Fig. 6; and 

Fig. 20 is a diagram illustrating still another example is 
of the game screen displayed on the monitor shown 
in Fig. 6. 



[0008] The following is a description of embodi- 
ments of the music staging game apparatus relating to 20 
the present invention, with reference to the drawings. 
[0009] Fig. 1 is a block diagram of an embodiment 
of the rhythm game apparatus according to the present 
invention. In Fig. 1, the rhythm game apparatus 1 serv- 
ing as the music staging game apparatus comprises: a 25 
plurality of staging operating means 1 A for staging input 
from a player by at least a striking operation; a storage 
means 1B for storing data regarding music and staging 
means for the music; a playing means 1c for playing the 
music based on the storage contents of the storage 30 
means 1 B; a staging operation instructing means 1 D for 
visually instructing the player in the staging operating 
using the staging operating means 1A, following the 
storage contents of the storage means 1B in a manner 
synchronous with the progression of the playing by the 35 
playing means 1C; a staging effects generating means 
1E for generating staging effects corresponding to the 
staging operation; an evaluating means 1F for evaluat- 
ing the staging operation based on the correlation 
between the staging procedures stored by the storage 40 
means 1B and the staging operation made by the 
player; and evaluation display means 1G for displaying 
information according to the evaluation results of the 
evaluating means 1 F to the player. 

[0010] The staging operating means 1 A has a plu- as 
rality of mimic percussion instruments 1 H provided each 
correlating to the plurality of series of rhythm sounds, 
and a rhythm input detecting means 1J for receiving the 
striking operating to the mimic percussion instruments 
1 H and detecting the operation timing of the corre- so 
spending rhythm sound. Though described later in 
detail with reference to Fig. 2 through Fig. 5, the plurality 
of mimic percussion instruments 1H are configured of 
drum pads 7 through 11 and a foot pedal 12, and the 
rhythm input detecting means 1 3 is configured of shock 55 
sensors 23 provided to the drum pads 7 through 1 1 and 
a micro-switch 35 provided to the foot pedal 12. The 
later-described foot pedal 12 comprises the bass drum 



foot pedal. 

[0011] The storage means 1B is comprised of a 
PCM data storage unit 42 later-described with reference 
to Fig. 6, a CD-ROM 45, and graphic RAM 47. 
[001 2] The playing means 1 C has speakers 3 and 4 
serving as a sound generating means described later, 
for reading and amplifying background music played 
music piece data of the CD-ROM 45 and outputting this 
from the speakers 3 and 4. 

[0013] The staging operation instructing means 1 D 
has a display means 1K serving as a monitor 2 as 
described later with reference to Fig. 6. and a display 
control means 1 L for displaying on the display means 
1 K the multiple types of staging as to music each corre- 
lated in the time-axial direction, as well as visually per- 
forming operation timing instructing of the multiple types 
of staging as to music. The display control means 1 L is 
comprised of the later-described main RAM 43, graphic 
controller 48, and CPU 52. 

[0014] The staging effects generating means 1E 
has a Sound output control means 1M, configured of 
main RAM 43 described later with reference to Fig. 6, a 
sound processor 44, and a CPU 52. 
[0015] The evaluating means 1F has a judging 
means 1N for judging whether or not the playing per- 
formed as to the music staged and input by the staging 
operating means 1A is instructed as operating timing 
within a certain time interval, and a staging input evalu- 
ating means 1P for comparing the operation timing of 
the staging operation means 1 A as to the staging of the 
music instructed as the operation timing with the opera- 
tion timing instruction by the display control means 1 L, 
thereby evaluating the staging input from this offset 
amount. The judging means 1 N and staging input eval- 
uating means 1 P are configured of the main RAM 43 
and the CPU 52 described later with reference to Fig. 6. 
[0016] The evaluation display means 1G is com- 
prised of the main RAM 43 described later with refer- 
ence to Fig. 6, the graphic controller 48, and CPU 52. 
[0017] Fig. 2 is an external perspective diagram of 
the rhythm game apparatus according to an embodi- 
ment of the present invention. In Fig. 2, the rhythm 
game apparatus 1 is provided with a television monitor 
2 (hereafter referred to as monitor 2) at the upper center 
portion of the front of the housing, for performing vari- 
ous types of image output relating to the rhythm game. 
Also, also, sound source full-range speakers 3 are pro- 
vided to both the left and right sides of the monitor 2 for 
audio output of the instrument sound according to the 
striking input instructions of the player along with the 
background music, and a low-range woofer speaker 4 is 
provided at the center position of the tower part of the 
front of the housing. Further, halogen lamps 5 are posi- 
tioned to the upper right and left positions on the hous- 
ing of the monitor 2 in order to produce staging effects 
by blinking and so forth with regard to the played music 
piece. These speakers 3 and 4 make up the sound gen- 
erating means serving as the playing means. 
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[0018] Also, the area below the monitor 2 is inclined 
so that the front of the housing is tilted with the forward 
direction being lower, thereby forming an array area 6 
for multiple mimic percussion instruments, where drum 
pads 7, 8, and 9 mimicking percussion instruments 5 
each having different tones are positioned in an Infor- 
mation (these are in an L-formation with the present 
embodiment, and the drum pads 7, 8, and 9 can be 
moved to the left or right) from the inclined front portion 
toward the deeper center portion, and further to the left 10 
of the drum pad 7 and to the upper side of the drum pad 
9 at the deeper right side are arrayed drum pads 1 0 and 
11 mimicking percussion instruments with differing 
tones such as cymbals. Further, a foot pedal 12 serving 
as rhythm input detecting means for a mimic percussion 75 
instrument such as a bass drum or the like is provided 
at the center near side of the lowest portion- of the front 
of the housing. Incidentally, the form of these mimic per- 
cussion instruments may be anything, as long as they 
are capable of mimicking the playing of percussion ~ 
instruments. 

[0019] Further, provided to the right side of the 
array area 6 for the mimic percussion instruments of the 
rhythm game apparatus 1 is a confirm/start button 13 
and selection buttons 1 4 and 1 5 on either side thereof,' 25 
with a coin deposit opening 1 6 being provided below the 
position at which these buttons are arrayed. 
[0020] The internal structure of these drum pads 7 
through 1 1 will be described. The drum pads 7 through 
9 have a circular external plan-view form, but such with 30 
generally half-circle shapes for the external plan-view 
form such as shown in Fig. 3A may be employed in the 
same manner, and the internal structure in this case will 
be described. 

[0021] As shown in Fig. 3B which is a cross-sec- 35 
tional view along line IIIB-IIIB in Fig. 3A, an inner metal 
plate 22 as provided at the rear side of the rubber pad 
21 of the drum pad at the generally center portion, and 
a shock sensor 23 is provided to the rear side of the 
inner metal plate 22. The shock sensor 23 serving as 40 
rhythm input detecting means for detecting striking com- 
prises an acoustic sensor, which detects striking of the 
surface of the rubber pad 21 with a stick at the striking 
operation timing thereof, and control is performed so as 
to cause an LED (Light Emitting Diode) 25 to emit light 45 
for an instant via a control circuit on the control board 24 
due to that detection signal, and further, that detection 
signal can be externally extracted at the striking opera- 
tion timing. The control board 24 is stored within a board 
case 26, and the board case 26 is attached to a trans- 50 
parent acrylic plate 27. The acrylic plate 27 is somewhat 
larger than the rubber pad 21 shown in Fig. 3A and is 
provided so as to frame the perimeter thereof in a 
flange-like manner. The acrylic plate 27 is provided so 
as to face a circular array of LEDs 25, such that the light 55 
emitted by the LEDs 25 pass through the acrylic plate 
27 and cause the edge portion extending from the 
perimeter of the rubber pad 21 to emit light. 



[0022] The interior structure of the foot pedal 1 2 will 
be described. In Fig. 4 and Fig. 5, the foot pedal 12 has 
a pedal 32 which has one end thereof axially supported 
to as to rock vertically with a shaft 31 as the center of 
rotation thereof, an elastic mender 33 which is retained 
at the tip portion of the pedal 32 at the side opposite to 
that of the shaft 31 , for pressing the pedal 32 upwards, 
a stopper member 34 for restricting the rotation of the 
pedal 32 pressed by the elastic member 33, a micro- 
switch 35 for detecting stepping on the pedal 32, and an 
actuator 36 for coming into contact with an operating 
piece of the micro-switch 35 at the time of the pedal 32 
rotating (at the time of stepping, shown by a double-dot- 
ted broken line) so as to cause this to move, thereby 
controlling on/off of the switch 35. 
[0023] In this way, the configuration is such that one 
player stands and plays the drum set comprised of the 
drum pads 7 through 1 1 and the base drum foot pedal 
1 2 with sticks in both hands along with the rhythm, using 
both hands and the right foot. The vertical position and 
inclination angle can be adjusted so that, in the case of 
playing in a sitting position, the height of the drum set is 
optimal in the event that a chair is provided and the 
player sits. That is to say, the frame member 17 to which 
the drum pads 7 through 9, 1.0, and 11 making up the 
inclined mimic percussion instrument array area 6 is 
axially supported at the deep side and also is config- 
ured so as to be vertically movable within a certain ver- 
tical range, and can also be adjusted regarding 
inclination toward the front of the array area 6. 
[0024] Fig. 6 is a block diagram illustrating the hard- 
ware configuration for the rhythm game apparatus 1 . In 
Fig. 6, the hardware configuration for the rhythm game 
apparatus 1 comprises a PCM data storage unit 42, 
main RAM 43 capable of reading and writing various 
types of data, a sound processor 44 connected to the 
PCM data storage unit 42 for extracting sound emission 
data from the PCM data storage unit 42 and performing 
sound emission control, a mixing unit 46 connected to 
the sound processor 44 for mixing the later-described 
sound emission data from the sound processor 44 and 
the background music data from the CD-ROM and out- 
putting this to the speakers 4 and 5 so as to serve as a 
sound generating means, graphic RAM 47 serving as 
graphic storing means for storing image data for the 
monitor 2, a graphic controller 48 connected to the mon- 
itor 2 for extracting the image data within the graphic 
RAM 47 and performing display control thereof on the 
monitor 2, an interface 50 for receiving input signals 
from the rhythm input detecting means 49 and the CD- 
ROM 45, a lamp driving unit 51 which is connected to 
the lamps 5 for performing lighting driving of the lamps 
5, and a CPU (Central Processing Unit) 52 for control- 
ling each part. The graphic RAM 47 makes up the 
graphic storing means, and the graphic controller 48 
and CPU 52 make up the graphic controlling means for 
performing image output control to the monitor 2. 
[0025] The PCM data storage unit 42 correlates 



4 



7 



EP 1 029 565 A2 



8 



multiple types of sound data (sound data with differing 
tones or multiple pieces of sound data) with the type of 
sound and thus stores the sound data. With sound data 
for such played music pieces, 12 to 15 music pieces for 
all play levels are stored in the PCM data storage unit 
42. Also, with regard to this sound data, information 
indicating the sector No., sound emission duration, etc., 
is stored in the PCM data storage unit 42. Also, the 
graphic RAM 47 stores screens relating to the notes dis- 
play 53 of the game screen shown in Fig. 7 and Fig. 8, 
and the CPU 52 controls the graphic controller 48 to 
divide the rhythm sound (notes bar 54 correlating to the 
rhythm sound), regarding a played music piece config- 
ured containing at least rhythm sound, in certain inter- 
vals (may be different or the same for each sound) in the 
time direction C, and extracts screens regarding the 
nodes display 53 from the graphic RAM 47 so as to 
make display on the monitor 42, such that display 
instruction is made for each sound on the notes bar 54 
of the series of rhythm sounds constructed by distribut- 
ing multiple types (with the present embodiment, there 
are 6 types of mimic .percussion instruments) of series 
of rhythm sounds on the same time axis. 
[0026] Also, the CD-ROM 45 serving as the storage 
medium stores background music data for the played 
music piece, an.d further stores the selection sound 
emission data (type of drum pad) for each sound of the 
played music piece and the output timing data (sound 
No.), and is configured of a so-called ROM cassette, 
wherein a ROM or the like storing score data according 
to the later-described degree of matching with these, as 
well as program data such as the control programs for 
the rhythm game and the operating system is housed 
inside a plastic case. The recording medium may be 
configured with an optical disk, flexible disk, etc., , 
instead of the CD-ROM 45. 

[0027] Further, as with the PCM data storage unit 
42, the graphic RAM 47 stores data for the notes screen 
53 such as shown in Fig. 7 and Fig. 8 for example for 
performing display instruction of rhythm striking input, < 
for visually guiding the rhythm striking input by the type 
of mimic percussion instrument. That is, the notes 
screen 53 such as shown in Fig. 7 and Fig. 8 is dis- 
played as notes bars 54 which are operating timing 
components for each rhythm sound corresponding to a 
each played music piece (BMG), the series of notes 
bars 54 indicating a series of rhythm sounds being 
arrayed in the vertical direction, such that the notes bar 
for each rhythm sound sequentially moves downwards 
along with each played music piece progressing and s 
displays and instructs the operating timing for the player 
to operate as the timing at which the notes bar for each 
rhythm sound reaches a horizontal reference line. The 
display instruction of the operating timing arrayed verti- 
cally in such a manner is lined up and displayed side- 5. 
ways by the type of mimic percussion instrument, and at 
the bottom of each vertical array there is a mark 58 for 
the mimic percussion instrument corresponding thereto. 



The vertical array of a series of rhythm sounds, i.e., the 
mark array of mimic percussion instruments matches 
the array of the drum pads 7 through 11 of the actual 
rhythm game apparatus 1. Also, the graphic RAM 47 
5 stores screens dealing with game states as shown 
below (e.g.. see Fig. 7 through Fig. 18) and various 
types of data relating thereto, in addition to the data for 
the notes screen 53. 

[0028] The CPU 52 reads data relating to the pro- 
w gram data within the CD-ROM 45 (score data, selection 
generation sound data, output timing data, etc.) from 
the CD-ROM 45 at the time of start-up, with an unshown 
reading device, and writes this to the main RAM 13. 
[0029] Also, based on the control program, the CPU 
is 52 controls the graphic controller 48 and extracts neces- 
sary image data (mode selection screen) from the 
graphic RAM 47 which is displayed on the monitor 2, 
and performs the mode difficulty selection processing 
and the stage selection processing, by means of the 
20 player making selection with the selection buttons 14 
and 15, and confirming with the confirm/start button 13. 
Based on the instruction command from the player with 
the selection buttons 14 and 15, mode selection 
screens such as shown in Fig. 10 through Fig.. 12 or 
25 sound selection screens such as shown in Fig. 13 and 
Fig. 14 are displayed. Incidentally, regarding the mode 
difficulty selection processing, the present embodiment 
uses the selection buttons 14 and 15 and the con- 
firm/start button 13, as described above, but the present 
30 invention is not restricted to such; rather, an arrange- 
ment may be used wherein the difficulty mode is 
selected by the player striking the drum pads 7 through 
9 and confirming the selected mode with the foot pedal 
12. For example, the mode selection screen shown in 
35 Fig. 1 0 would be come up in the event the normal mode 
is selected by striking the drum pad 7 "with a stick, the 
mode selection screen shown in Fig. 1 1 wouJd be come 
up in the event the practice mode is selected by striking 
the drum pad 8 with a stick, and the mode selection 
fo screen shown in Fig. 12 would be come up in the event 
the real mode is selected by striking the drum pad 9 with 
a stick. 

[0030] In the mode difficulty selection processing, 
there are four modes provided; the practice mode for 

5 beginners, the normal mode for medium level, the real 
mode for advanced, and the expert mode which is the 
highest level. With the practice mode or normal mode, 
the combinations of hands and feet are restricted to 
basically only both hands, or to the right foot and left 

o hand (or right hand), and the setting is arranged such 
that similar rhythm patterns are repeated due to the 
nature of the beginner level, with occasional feint 
rhythms and phrases with increasing complexity making 
for the nature of the game. Also, with the real mode and 

? expert mode, fast tempo and advanced level stick-han- 
dling using at least both hands is required, and the set- 
ting is arranged such that the game nature is a 
challenge for advanced buffs. Particularly, with the 
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expert-real mode, the touch intensity in striking the 
drum pad is required. That is to say, -the judgment eval- 
uation in the rhythm game is not only for the timing for 
the drum pad striking operation, but touch intensity of 
the striking operation is contained in the judgment evai- 5 
uation as well. 

[0031] Also, with the stage selection processing, a 
sound selection screen such as shown in Fig. 13 and 
Fig. 14 displayed on the monitor 2, and is arranged such 
that the player selects the played music piece using the w 
selection buttons 14 and 15 and the title displayed on 
the display screen is confirmed as the selected music 
piece with the confirm/start button 13. Also, multiple 
note symbols corresponding to the difficulty level of the 
played music piece are arrayed horizontally and dis- is 
played on the monitor 2. Each time the selection button 
14 is pressed, the title corresponding to the next played 
music piece is displayed on the monitor 2. Also, each 
time the selection button 15 is pressed, the movement is 
in the reverse direction (to the right) as compared to the 20 
selection button 14. For example, the title portion of the 
screen on the monitor 2 shown in Fig. 13 has displayed 
the title "I THINK ABOUT YOU" of the played music 
piece, *and this is in a state of being selected. In the 
event that this selected piece is suitable, the con- 25 
firm/start button 13 is pressed following the operation 
guidance on the display screen, and the played music 
piece is confirmed. 

[0032] Also, the CPU 52 comprises: judging means 
for judging whether or not sound data according to the 30 
type of mimic percussion instrument input-detected and 
input-instructed with the drum pads 7 through 1 1 and 
bass drum foot pedal 12 has been instructed as striking 
or pedal operation timing within the certain interval, fol- 
lowing the sound generation output control procedures 35 
of the control program; and sound output control means 
for extracting one piece of sound emission data of a 
played music piece from the PCM data storage unit 42 
with the sound processor 44 according to the type of 
mimic percussion instrument from the drum pads 7 40 
through 11 and foot pedal 12, and the output timing 
thereof (sound No.), and outputting this to the mixing 
unit 46, mixing the one piece of sound emission data 
and the background music data from the CD-ROM 45 
and conducting sound emission output from the speak- as 
ers 3 and 4, in at least a state that the judging means 
has affirmed (instructed as striking or pedal operating 
timing within the certain interval); and has display con- 
trol means for updating the data on the notes screen 53 
according to the flow of the time-system of the played so 
music piece, and also for performing display control on 
the monitor 2 regarding the level of matching in the strik- 
ing with the sticks or pedal operation on the mimic per- 
cussion instruments such as the later-described 
"Perfect", and whether or not there has been a miss in 55 
the input, following the notes display control means of- 
the control program; and rhythm input operation evalu- 
ating means for comparing the timing of the striking or 



pedal operation on the mimic percussion instruments 
with the sound emission data for playing and output tim- 
ing data, and for evaluating the rhythm input from the 
score data according to the latter-described degree of 
matching, thereby adding to the score, following the 
rhythm input operation evaluation procedures of the 
control program. The sound output control means has a 
later-described offset amount detecting means and 
sound emission control means. 

[0033] The sound output control processing and 
display control processing will be described in detail. 
The CPU 52 obtains the next CD sector No. for the 
music piece played from the CD-ROM 45 via the inter- 
face 50, and controls the graphics controller 48 based 
on the obtained CD sector No. to read in image data 
from the graphic RAM 47 which is the graphic storage 
means and updates the next notes display 53, and dis- 
plays the updated notes display 53 on the monitor 2 as 
shown in Fig. 7 or Fig. 8. That is to say, the configuration 
is such that, during execution of the program, the sector 
No. which the CD head is pointing to is obtained for 
each interruption, and the notes display 53 shown in 
Fig. 7 or Fig. 8 is moved downwards according to the 
time value of that sector No., and performs sound in put 
display instruction for the player to conduct striking with 
the stick or pedal operation for the notes bar 54 (notes 
bards for each of the mimic percussion instrument drum 
pads 7 through 11 and foot pedal 12) which has 
reached the reference line 55. 

[0034] In this way, the player inputs command sig- 
nals to the CPU 52 by striking the mimic percussion 
instrument drum pads 7 through 1 1 with sticks held in 
the right and left hands or operating the foot pedal 12 
with the pedal, along with the background music, while 
confirming the notes display 53 to the left side of the 
monitor 2 in Fig. 7 or Fig. 8, for example. At this time, at 
the point that there has been input of the command sig- 
nal within the certain timing period, the CPU 52 calcu- 
lates the degree of matching with the sound data in a 
table. 

[0035] This degree of matching (amount of match- 
ing) is the extent to which the input timing of striking the 
mimic percussion instrument drum pads 7 through 11 
with sticks or operating the foot pedal 12 with the pedal 
matches the display instruction timing displayed as 
notes. For example, this sound output is such that in the 
event that the sector No. obtained at the time of stick 
striking or pedal operating and the sector No. of the cor- 
responding sound data are within a certain interval, and 
also in the event that the input instruction has been 
made from the same type of mimic percussion instru- 
ment (drum pads 7 through 11 and foot pedal 12) in 
matching amount table, the sound data corresponding 
to the sound No. within the same matching amount table 
is output as sound for the duration of the sound emis- 
sion thereof. In the event that the "within the certain 
interval" consists of within the time width Pe which is 
generally the same as the sound duration correspond- 
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ing to the notes bar 54 in the notes display 53 as shown 
in Fig. 17, this makes for a evaluation level of "Perfect" 
from multiple levels (with the present embodiment there 
are 4 evaluation levels) set, in the event that this is 
within the time width Gr set before and after the time 5 
width Pe, this consists of "Great", in the event that this is 
within the time width Go set before and after the time 
width Gr, this consists of "Good", and in the event that 
this is within the time width Po set before and after the 
time width Go, this consists of "Poor". The superiority or 10 
inferiority of this evaluation level is displayed to the 
player by changes in graphics representing the notes, or 
temporarily displaying characters representing the eval- 
uation. Also, the time width at the trailing side of this 
"Poor" has been made to be somewhat longer than as r5 
compared with other time widths (the time width set for 
"Perfect", "Great", and "Good"), and the time of a pedal 
operation has been made to be somewhat longer than 
as compared with other time widths (the time width set 
for the striking operation). Also, in the event that the 20 . 
player misses a notes bar 54 and does not perform the 
striking or pedal operation within the certain time inter- 
val, i.e., in the event that there is no input instruction 
within the certain interval, this constitutes a "Miss", so 
that a strike outside of the time width Po in the free zone 25 
(the inter-line area time-divided every 16 notes, where 
no notes bars 54 exist), there is no judgment. An 
arrangement may be made wherein there is no output of 
rhythm sound even in the event that the player ad-libs 
and performs strike inputting in this free zone, but with 30 
the present embodiment, a warning sound (amiss 
sound) for notifying that the operating timing is off, is 
output. In this way, a warning sound (a miss sound) is 
output in the event that the amount of offset in degree of 
matching is great, and in the event that this is not the 35 
case, a normal sound chord is sounded. Also, the warn- 
ing sound (miss sound) is an appropriate combination 
of normal sound chords, and a sound that is not irksome 
is preset for each music piece or mode. 
[0036] In the event that there is striking or pedal 40 
operation within the "Perfect" or "Great" time, fireworks 
57 indicating congratulation are displayed on the notes 
display screen as shown in Fig. 7 and Fig. 8, and the 
halogen lamps 5 blink, with the characters "Perfect" or 
"Great", indicating the degree of matching, flowing as 
along the vertical lines of the mimic percussion instru- 
ment, and the mark 58 of the mimic percussion instru- 
ment shining. 

[0037] At this time, the notes bar 54a itself blinks 
intensely only for the instant of the striking or pedal so 
operation, as shown by the notes bar 54a which has 
reached the reference line 55. Also, in the event that 
there is striking or pedal operation within the "Good" or 
"Poor" time width, the characters "Good" or "Poor" are 
displayed on the vertical display area in the notes dis- ss 
play 53 for the mimic percussion instrument which was 
operated, and only the perimeter of the mark 58 for the 
mimic percussion instrument which was "Good" or 



"Poor" shines. Further, in the event that the strike or 
pedal operation is within the certain time interval, in the 
event that the type of mimic percussion instrument is 
wrong, there is no sound output, and no related display. 
The display on the monitor 2 at this time is also "MISS" 
shown in Fig. 15 which represents a miss, on the verti- 
cal line for the mimic instrument. In this way, the sound 
data for the sound which the player has selected the 
mimic percussion instrument at the input instruction tim- 
ing of striking the mimic instrument with the stick or 
pedal operation is obtained by the CPU 52 controlling 
the sound processor 44 from the PCM data storage 
means 42, and the sound is emitted via the speakers 3 
and 4. 

[0038] Also, the vertical line of the display instruc- 
tion for the pedal operation is shining white, and further 
the vertical line for the pedal operation is positioned at 
the general center, so the visual recognition thereof is 
much better than that of the other drum pads. 
[0039] The rhythm input operation evaluating proc- 
ess with be described in detail. The CPU 52 follows the 
rhythm input operation evaluation procedures of the 
control program and the game data to extract and calcu- 
late score points from the scores table according to var- 
ious conditions, such as the amount of offset from the 
reference timing range of the input instruction timing of 
striking the mimic percussion instrument with the stick 
or pedal operation (the levels in degree of matching), 
mistakes in the type of mimic percussion instrument at 
this time, whether or not a series of continuous opera- 
tion inputs are of a certain level in the degree of match- 
ing (bonus points are set for cases wherein there is 
continuous operation input within the time width of "Per- 
fect" and "Great"), cases wherein there is no input of 
instruction signals which should have been within the 
certain timing period. For example, in the event that the 
operation timing of the instruction signals is within the 
same time width Pe as to the notes bar 54 of the notes 
display 53, this is "Perfect" and the score is +2, in the 
event this is within time width Gr, this is "Great" for +1, 
in the event this is within time width Go, this is "Good" 
for- } 0, in the event this is within time width Po, this is 
"Poor" for -5, and in the event that the striking or pedal 
operation is not performed but the notes bar 54 is 
missed, this means a "Miss" for -1 0. In the event that the 
degree of matching is off any greater than this, the judg- 
ment does not count. 

[0040] Also, the CPU 52 is arranged so that accu- 
mulation calculation is performed such that the gauge 
amount is decreased in the event that the operation tim- 
ing of the player to the mimic percussion instrument is 
within the "Poor" time width or in the case of a "Miss", 
and the gauge amount is increased in the event that the 
operation timing is within the "Perfect" or "Great" time 
width. Based on the gauge amount calculation results 
and the score calculation results, the calculating score 
is added to the accumulated score and updated and 
stored in the main RAM 43, and at the same time the 
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calculated gauge amount is reflected in a horizontal bar 
graph 56 on the monitor 2 as shown in Fig. 7 and Fig. 8, 
with the length thereof in a certain direction being 
changed and thus displayed accordingly. The CPU 52 
controls the graphic controller 48 such that in the event 
that the updated gauge amount is gone, a display such 
as "Game Over" is displayed on the monitor 2 and the 
game is force-quit, and a grades display screen such as 
shown in Fig. 16 for example is displayed on the monitor 
2. 

[0041] The operation of the above configuration will 
be described below. 

[0042] First, the peripheral demo will be described. 
First, a warning screen shown in Fig. 9 displaying a 
warning text such as age restriction or the like is dis- 
played on the monitor 2, an opening video is displayed, 
the title of this rhythm-matching game is displayed, and 
further, how to play this rhythm-matching game (opera- 
tion method) is described. Also, a demo of a noted 
music piece is performed. That is to say, the number of 
times that each piece has been selected in the rhythm 
game is recorded following data initialization once every 
certain period such as a week, and that data is used to 
read the date and time, and a piece matching that 
period such as the season, day of the week, or the like 
is introduced, and also the piece with the greatest 
number of selections when demo looping is output as 
audio as the "No. 1 popular piece". Further, the name of 
the high-score player and the high score thereof for the 
week is displayed in order of high score, thus perform- 
ing a ranking demo. Subsequently, the flow returns to 
the warning screen. Incidentally, the rhythm game appa- 
ratus 1 is arranged such that the player name can be 
input from input means (not shown) in the event that a 
certain high-score value is passed. 
[0043] In the event that a coin of a certain monetary 
value is deposited from the coin deposit opening 1 6 dur- 
ing the above routine, the title of the rhythm game is dis- 
played on the monitor 2, following which the CPU 52 
controls the graphic controller 48 based on the control 
program to extract necessary mode selection image 
data such as shown in Fig. 1 0 from the graphic RAM 47, 
and display this on the monitor 2. 

[0044] Fig. 1 8 is a flowchart showing the operations 
of the rhythm game apparatus in Fig. 1 . As shown in Fig. 
18, first, in step ST1, difficulty mode selection process- 
ing is performed. That is, the player pressing the selec- 
tion button 14 once from the normal mode state shown 
in Fig. 10 selects the practice mode shown in Fig. 11, 
pressing the selection button 15 once from the practice 
mode state shown in Fig. 11 returns to the norma! 
mode, and further pressing the selection button 1 5 once 
more selects the real mode. Further, pressing the selec- 
tion button 15 once more from the real mode state 
selects the expert mode, though not shown in the draw- 
ings. In this way, pressing the confirm/start button 13 in 
the state with the practice mode selected selects the 
practice mode, pressing the confirm/start button 13 in 



the state with the normal mode selected selects the nor- 
mal mode, pressing the confirm/start button 13 in the 
state with the real mode selected selects the real mode, 
and pressing the confirm/start button 1 3 in the state with 
5 the expert-real mode selected selects the expert-real 
mode. In order to simplify description, the following will 
be described with reference the case of the normal 
mode. Also, the practice mode will be mentioned later 
as a practicing mode. 

w [0045] Next, stage selection processing is per- 
formed in step ST2. That is, as shown in Fig. 13, selec- 
tion of the played music piece is performed such that 
multiple notes corresponding to the difficulty of the 
played music piece are displayed on the monitor 2, so 

15 pressing the selection button 1 4 once displays the title "I 
THINK ABOUT YOU" for the next played music piece to 
the left side of the monitor 2. Also, pressing the selec- 
tion button 15 once displays the title "YOU CAN MAKE 
IT" for the played music piece to the left side of the mon- 
20 itor 2. In the state that the tile of the played music piece 
is displayed, pressing the confirm/start button 13 final- 
izes the selection of the played music piece for the dis- 
played title. 

[0046] Further, data is loaded in step ST3. Control 

25 programs for instructing the procedures for the rhythm- 
matching game and related data, other than the back- 
ground music data, are read into the main RAM 13 from 
the CD-ROM 45 which is the recording medium. Thus, 
once the preparation for playing as completed, the 

30 game screen such as shown in Fig. 7 and Fig. 8 is dis- 
played on the monitor 2 in step ST4. The notes display 
53 indicating the operation timing instruction proce- 
dures for the striking or pedal operation for each of the 
mimic percussion instruments as to. the selected music 

35 piece is displayed on the side of the monitor 2. A screen 
corresponding with the state of the music piece accord- 
ing to that selected music piece is displayed on the right 
side of the monitor 2. Further, the amount of life remain- 
ing before the game is over is displayed at the upper 

40 right side of the monitor 2, in the form of a horizontal bar 
graph 56. 

[0047] The notes display 53 displayed on the moni- 
tor 2 has notes bars 54 indicating the operating timing of 
the series of rhythm sounds in a vertical array corre- 

45 sponding to the marks for the mimic percussion instru- 
ments sequentially come down from above, and also 
the player must strike or perform pedal operation of the 
mimic percussion instrument corresponding to the mark 
at the point that the notes bar 54 reaches the reference 

so line 55 above the mimic percussion instrument mark. 
[0048] Further, the CPU 52 obtains the CD sector 
No. that the CD is currently reproducing in step ST5, 
and updates the position of the notes display 53 in step 
ST6. The player watches the notes display 53 (the tim- 

55 ing instruction procedures for the striking or pedal oper- 
ation of the mimic percussion instruments) to the left of 
the monitor 2, and performs striking and/or pedal oper- 
ation of the mimic percussion instruments with the left 
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and right hands and/or right foot, along with the back- 
ground music. At this time, input instruction signals are 
output to the CPU 52, and the CPU 52 judges whether 

tostep ST7 bee ° Si9nal inPUt Within 3 ° ertain timin 9 
[0049] At the point that the player has performed 
striking or pedal operation in step ST7, the extent of 
matching (degree of matching) between the type of 
mimic percussion instrument to which the striking or 
pedal operation was performed in step ST8 and the w 
input detection timing thereof, and the sound data in the 
table (the type of mimic percussion instrument for the 
rhythm sound in the played music piece, and the opera- 
tion timing thereof) is obtained, and in step ST9 at the 
input detection timing to the mimic percussion 'instru- 15 
ment, the CPU 52 controls the sound processor 14 to 
obtain rhythm sound data corresponding to the mimic 

t P ho C p™°w instmment in the P'^d music piece from 
the PCM data, and mixes that rhythm sound data with 
the background music data from the CD-ROM 45 and 20 
the mixing unit 46, and emits sound from the speakers 3 
and 4. Further, in step ST10, the remaining life amount 
(gauge amount) calculation for how longer the game 
can be played, and score calculation is performed That 
is scores are extracted from the score table in step 25 
ST10 and calculated according to conditions such as 
the amount of offset from the reference timing range for 
the input detection timing of the striking or pedal opera- 
tion to the mimic percussion instruments as described 
above the level of degree of matching), mistakes in the 30 
type of mimic percussion instrument, cases wherein 
continuous striking or pedal operation is correct, cases 
wherein input of input instruction signals from striking or 
pedal operation which should have existed within a cer- 

Ind Wh 9 P t K i0d StSP ST? bUt did not ' and so 35 
and further, the time necessary for the striking or pedal 
operation input is calculated. 

FUrther ' thS 9aU96, score - and sta 9ing ^ 

SSSi" 1 T 1 ' baSSd ° n 9aU9S am °-t cal- 
culations and score calculation results in step ST10 40 
"hat is, the score calculated in step ST10 is added to 
the accumulated score and updated and stored in the 
man RAM 43. Also, in the event that the operation «m 
Sr ° n the mimiC P ercus *i°n instruments in 

2 I ' S Within thS time Widtn of " Poor " ™ is a 45 
Miss , the gauge amount is decreased, and in the 
event that the operation timing is within the time width of 
Perfect and "Great", accumulation calculation is made 
to increase the gauge amount, and this is displayed as 
the horizontal bar graph on the monitor 2 as repre- so 
sented by reference numeral 56 in Fig. 7 and Fig. 8 
[0051] Further, in step ST12, judgment is made 
whether or not playing of the selected music piece has 
ended or not is made by detecting the presence or 

PCMd C a e t a Jr ndj ? 9 C ° de attaChSd 3t the end ° f th * « 
CPU ? e Se ' eCted music P fece °bt^ned by the 
th» ,h ? S ° Und P rocessor 44. and in the event 
that the playing of the selected music piece has not 



ended, the flow returns to step ST5. 
[0052] Also, in the event that step ST1 2 yields YES 
(the playing of the selected music piece has ended) 
judgment is made in step ST13 whether or not selected 
music piece has been cleared, and in the event that the 
selected music piece has not been cleared, a game 
interruption display is made on the monitor 2 in step 
b ri4, and the game is ended. Also, in step ST13 in the 
event that the selected music piece has been cleared in 
step ST15 a grades display screen including total 
scores as evaluation of the playing based on the sore 
calculation results such as shown in Fig. 16 for exam- 

tl e r ' aT" T? atl0n (eg - displayed ^ a'Phabet let- 
ters A through E, etc.) and the like, on the monitor 2 
thereby notifying the player of the stage results 

f?° 5 ?o, , in Step ST16 ' i ud gment is made by 

tne CPU 52 regarding whether or not a stipulated 
number of stages (e.g. up to three selected pieces can 
be selected) has been achieved, along with whether or 
not there is any remaining life amount updated, and in 
the event that the stipulated number of stages has been 
achieved or there is no remaining life amount the game 
ends, and in the event that the stipulated number of 
stages has not been achieved or there is yet remaining 
We amount, the flow returns to step ST2 and performs 
the series of processing for the next sound (step ST3 
through ST15) and this is repeated until the stipulated 
number of stages has been completed or there is no life 
amount remaining. 

H . Subsequently, in step ST1 6, in the event that 
the CPU 52 detects the ending code attached to the end 
of the PCM data of the selected music piece (the stipu- 
lated number of stages has been completed), judgment 
is made that the playing of the selected music piece has 
ended so the CPU 52 controls the graphic controller 48 
to make a game-over display on the monitor 2, to end 
the game. 

[0055] Next, the operation of the practicing mode 
(practice mode) will be described. In the event that the 
practice mode is set, first, a teacher for performing a 
model performance appears on the monitor 2 and plays 
a certain practice piece, which the player listens to and 
learns the sense of operation timing for the striking or 
peda operation. Next, a game screen such as shown in 
Fig. 19 and Fig. 20 for example is displayed on the 
screen of the monitor 2, and the operation timing for the 
striking or pedal operation to the mimic percussion 
instruments for that practice piece are displayed and 
instructed on the position of the notes display 53, alonq 
with which the striking or pedal operation is performed 
whereby sound is emitted according to the type of mimic' 
percussion instrument and the input detection timing 
l he type of mimic percussion instrument and the oper- 
ation timing made by the player is judged by the evalua- 
tion of the rhythm-matching game depending on 
whether or not it matches the display instruction timing 
m the notes display 53, as with the above-described 
normal mode. 
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[0056] As described above, according to the 
present embodiment, the CPU 52 controls the graphic 
controller 48 based on the control program within the 
main RAM 43 to extract a series of rhythm sound data 
for each of the multiple mimic percussion instruments 5 
each from the graphic RAM 47 and display these in a 
related manner in the time-axial direction on the monitor 
2, perform display instruction for operation timing 
regarding the sounds of the multiple mimic percussion 
instruments on the monitor 2, sequential striking input of 10 
rhythm sounds is performed by the player with the left 
. and right hands for example via the rhythm input detect- 
ing means 49 corresponding to the multiple mimic per- 
cussion instruments, while confirming the operation 
timing display instructions, and the timing thereof is 15 
compared with the display instruction timing and evalu- 
ation is made from the offset amount, and the evaluation 
results are accumulated, so a rhythm-matching game 
with a higher gaming nature can be realized, and also, 
even though percussion instrument playing is per- 20 
formed in a state closer to reality using at least the right 
hand and left hand, and further the right foot, for rhythm 
sound input, the rhythm -matching game does not 
become complex, and can be carried out relatively eas- 
ily. 

25 

[0057] Also, the rhythm input detecting means can 
be easily configured by attaching shock sensors 23 to 
mimic percussion instruments. Also, in the event that 
the shock sensors 23 detect not on/off but detect analog 
striking amounts, the sound data can have touch inten- 30 
sity, which gives a greater variety of sounds emitted by 
sound emission instruction, and the gaming of the- 
rhythm-matching game can be carried out at an even 
higher level. 

[0058] Further, drum pads 7 through 9 are used for 35 
drums, drum pads 10 and 1 1 for cymbals, and the foot 
pedal 12 for the bass drum, etc., i.e., multiple mimic per- 
cussion instruments are used, so the rhythm-matching 
game can be carried out using right and left hands and 
further the feet, in a state closer to reality. 40 
[0059] Further, the display array of each series of 
rhythm sounds in the notes display 53 on the monitor 2 
matches the array of the multiple mimic percussion 
instruments, and marks represent the mimic percussion 
instrument corresponding to the display area for each 45 
series of rhythm sounds, so the display array for guiding 
the striking or pedal operation of the multiple mimic per- 
cussion instruments along the time-system is extremely 
readily viewed. 

[0060] Further, the various display forms are so 
changed at the operating timing in the notes display 53 
on the monitor 2, so whether the operating timing is 
good or bad is clearly understood in real-time, so the 
player can perform the game at a high level. 
[0061] Further, sound emission output control and 55 
rhythm input evaluation is performed according to the 
sound selection contents (type of the mimic percussion 
instrument) and the input detection timing thereof, so 



evaluation can be made accurately on an evaluation 
standard, so in the event that two take turns to play, the 
two can compete regarding the evaluation standard, 
and the rhythm-matching game can be enjoyed in a fair 
and objective manner. 

[0062] Further, sound emission instruction is per- 
formed with the notes display 53 as a guide, so even a 
relatively complex played music piece can be easily 
played in the rhythm -matching game. Also, misses in 
input are displayed on the notes display 53 in real-time, 
so the player can identify and immediately correct 
his/her mistake in real-time, thereby allowing the 
rhythm-matching game to be enjoyed at an even higher 
level. 

[0063] Incidentally, with the present embodiment, 
the display for instructing sound emission timing by the 
display control means is of a configuration wherein the 
notes bars 54 are sequentially displayed from the top 
toward the bottom on the monitor 2, as shown in the 
notes display 53 in Fig. 7 and Fig. 8, but configurations 
may be made wherein the notes bars 54 are scrolled 
from the bottom toward the top on the monitor 2, or from 
one horizontal side toward the other side, thereby mak- 
ing sequential display. 

[0064] The present invention is not restricted to the 
above embodiments, and the following variations can be 
employed. 

(1) With the present embodiment, the timing as to 
the sound data instructed as input detection timing, 
and the operation timing instruction display in the 
notes display 53 are compared, and the rhythm 
input is evaluated based on that offset amount, but 
the evaluation means may evaluate based on the 
total offset amount obtained by accumulating the 
offset amount for each piece of sound data, or an 
arrangement may be made wherein the evaluating 
means sets a tolerance range before and after the 
operation timing of each piece of sound data, and 
calculates score by accumulating subtraction val- 
ues set according to the smallness of the amount of 
being off within the inner side of the boundary of the 
tolerance range as a reference thereof, and addi- 
tion values set according to the greatness of the 
amount of being off at the outer side thereof. 

(2) According to the present embodiment, in the 
notes display 53, the notes bars 54 of rhythm 
sounds sequentially move downwards along with 
elapsing of time toward the reference line 55, with 
the point of matching the reference line 55 being 
the timing for striking or pedal operating, and here, 
the notes bars 54 move, but the invention is not 
restricted to this, so the reference line 55 may 
move, or the reference line 55 and the notes bars 
54 may move, with the overlapping point being the 
input instructing timing. 

(3) With the present embodiment, the arrangement 
is such that one or multiple pieces can be selected 
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from five pieces for four stages of play levels high- 
est level (expert-real), advanced (real), medium 
(normal), and beginner (practice), but an arrange- 
ment may be made wherein multiple pieces (e g 
three) other than the five are hidden, and at the « 
point that the selection of pieces remaining is close 
to being depleted, the hidden three pieces then 
appear on the monitor 2, so as to be selectable 
This reduces the unfairness for individuals select- 
ing pieces at the point that the selection of pieces ,„ 
remaining is close to being depleted, and the 
rhythm-matching game can be enjoyed more. 
(4) With the present embodiment, a description has 
been made drums, bass drums, and further cym- 
bals as input means mimicking percussion instru- 15 
ments, but the invention is not restricted to this and 
can be applied to other percussion instruments 
such as xylophones, glockenspiels, kettledrums 
other percussion instruments, and so forth 
(5) With the present embodiment, the sound output 20 
control means is configured so as to output the 
sound data instructed as the operating timing to the 
sound emitting means and be emitted, but the 
invention is not restricted to this, and the sound 
emitting means may be controlled so as to conduct 25 
sound output only of background music, without 
outputtmg sound data instructed as operating tim- 
ing to the sound emitting means, with evaluation of 
the .nput being displayed and output in the same 
manner as with the above embodiment 30 
(6) With the present embodiment, the foot pedal 12 
has been provided as the rhythm input detecting 
means for the bass drum, to be operated with the 
right foot; ,n addition, or independently instead of 
this, a high-hat pedal (for emitting short or long 35 
cymbal sounds) for operation with the left foot may 
be provided. In this case, performing operation 
instruction for simultaneous operation of the high- 
ha pedal and the drum pad 1 0 eguivalent to a cym- 
bal is even more effective. 

(7) With the present embodiment, percussion 
instruments such as drum pads / through 9 mimick- 
ing drums with differing tones and drum pads 10 
and 1 1 mimicking cymbals with differing tones have 
been provided, but the present invention is not 45 
estricted to such; rather, the drum pads 7 through 
1 1 may be correlated to drum sounds of all different 
tone and/or the same tone drum sound, or, drum 
pads 7 through 1 1 may be other instruments, par- 
hcularly percussion instruments (e.g., kettledrums so 
or other percussion), or even piano sounds, and fur- 
ther may even be sounds of people, animal sounds 
or other sounds (such as sea waves roaring). Fur- 
ther, the arrangement may be such wherein the 
tone changes while playing. 

(8) with the present embodiment, the staging oper- * 
a ton means are configured of drum pads 7 through 
1 1 for mimic percussion instruments and shock 



sensors 23 attached to each, with these being 
arrayed at the front of the housing, but the present 
invention is not restricted to such; rather, the posi- 
tion of the mimic percussion instruments may be at 
the front of the housing and arrayed around a posi- 
tion facing the front thereof. Any arrangement is 
permissible so long as the multiple types of drum 
pads are arrayed within reach of the player and cen- 
tered in front of the housing. 
(9) With the present embodiment, an example has 
been described of a rhythem game apparatus stag- 
ing various displays with a monitor 2 other than the 
rhythm sound of the percussion instruments and 
wing lamp effects, as staging put on to the music 
along with matching rhythm sounds of percussion 
instruments such as a drum set, but the present 
invention is not restricted to such; any arrangement 
is permissible so long as it is a music staging game 
apparatus which performs playing regarding music 
Various kinds of staging for the music can be con- 
ceived, other than the rhythm sound of the percus- 
sion instruments and various displays on the 
monitor 2, and further lamp effects. 



[0065] As described above, according to a first 
aspect of the present invention, a music staging game 
apparatus comprises: a plurality of staging operating 
means positioned in front of the housing and facing 
around a position at the front thereof for staging input 
from a player by at least a striking operation; a storage 
means for storing data regarding music and staging 
means for the music; a playing means for playing the 
mus,c based on the storage contents of the storage 
means; a staging operation instructing means for visu- 
ally instructing the player in the staging operating using 
the staging operating means, following the storage con- 
tents of the storage means in a manner synchronous 
with the progression of the playing by the playing 
means; a staging effects generating means for generat- 
ing staging effects corresponding to the staging opera- 
tion; and an evaluating means for evaluating the staqino 
operation based on the correlation between the staging 
procedures stored by the storage means and the slag 
mg operation made by the player. Also, the staging 
operation instructing means may have a display means 
and a display control means for displaying on the dis- 
play means the staging of a plurality of types as to music 
m a manner respectively related in the time axial direc- 
.on, and for visually performing operation timing 
instruction for a plurality of types of staging for the 
music; and the evaluating means may have judging 
means forjudging whether or not the staging as to the 
music subjected to staging input from the staging oper- 
ating means has been instructed as operating timing 
wrth.n a certain time interval, and a staging input evalu- 
ating means for comparing the operation timing of the 
staging operation instructing means as to the staging of 
the music instructed as the operation timing with the 
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operation timing instruction by the display control 
means, thereby evaluating the staging input from this 
offset amount. 

[0066] According to the above configuration, the 
staging operation using multiple staging operating s 
means for staging input by the player comprised of at 
least a striking operation is visually displayed and 
instructed to the player following the stored contents of 
the storage means, and sequential striking input is per- 
formed with the left and right hands for example for 10 
staging of music corresponding to multiple staging oper- 
ating means, while confirming the operation timing dis- 
play instructions of the striking operation at least, so a 
music staging game with higher gaming nature is real- 
ized, and also, even though staging operation for music is 
is performed in a percussion instrument playing state 
closer to reality using at least the right hand and left 
hand, and further the foot, operating for the music stag- 
ing is performed based on visual display instructions, so 
the complexity of the music staging game is lightened, 20 
and can be carried out relatively easily. 
[0067] Also, a sound generating means may be pro- 
vided as the playing means, a sound output control 
means may be provided as the staging effects generat- 
ing means, and the staging as to the music is comprised 25 
of a series of rhythm sounds; and the staging operating 
means may consist of a plurality of mimic percussion 
instruments provided each correlating to the plurality of 
series of rhythm sounds, and a rhythm input detecting 
means for receiving the striking operating to the mimic 30 
percussion instruments and detecting the operation tim- 
ing of the corresponding rhythm sound. Specifically, the 
rhythm game apparatus according to the present inven- ' 
tion may comprise: a rhythm sound storing means for 
dividing the rhythm sound of a played musical piece, 35 
comprised including at least rhythm sound, at certain 
intervals in the time direction thereof, and also for stor- 
ing multiple series of rhythm sounds structured as at 
least a series of rhythm sounds on the same time axis, 
as sound data one sound at a time; a display means; a 40 
display control means for displaying on the display 
means multiple series of rhythm sounds correlated in 
the time axial direction, and also for instructing the oper- 
ating timing for each sound; multiple mimic percussion 
instruments provided so as to correspond with multiple 45 
series of rhythem sounds; rhythrm input detecting 
means for receiving a striking operation to the mimic 
percussion instruments and detecting this as the oper- 
ating timing of the corresponding series of rhythm 
sounds; a judging means for judging whether or not the 50 
sound data detected by the rhythm input detecting 
means is instructed as operating timing within the cer- 
tain interval; a sound emitting means; a sound output 
control means for outputting at least background sound 
to the sound emitting means; and an evaluating means 55 
for comparing the operating timing of the rhythm input 
means as to the sound data instructed as the operating 
timing and the operating timing display instruction, and 



for evaluating the rhythm input operation from the offset 
amount thereof. 

[0068] Also, according to a second aspect of the 
present invention, the method thereof comprises: a step 
for dividing the rhythm sound regarding a played music 
piece, configured containing at least rhythm sound, in 
certain intervals in the time direction, and for displaying 
on a display means a plurality of series of rhythm 
sounds, each configured as a series of rhythm sounds 
on the same time-axis, and for performing display 
instruction of the operating timing for each sound; a step 
for controlling the sound generating means to output at 
least background sound; a step wherein one piece of 
sound data is selectively instructed for a type of the 
mimic percussion instruments provided correlating to 
each of the plurality of series of rhythm sounds and an 
operating timing thereof, and judging is made whether 
or not the instructed sound data is instructed as operat- 
ing timing within the certain interval; and a step for com- 
paring the operating timing as to the instructed sound 
data with display instruction timing of the operation tim- 
ing, and for evaluating the rhythm input from the offset 
amount thereof. 

[0069] Also, a third aspect of the present invention 
comprises a computer-readable storage medium 
wherein are recorded control programs for executing the 
following steps: a step for dividing the rhythm sound 
regarding a played music piece, configured containing 
at least rhythm sound, in certain intervals in the time 
direction, and for displaying on a display means a plural- 
ity of series of rhythm sounds, each comprised as a 
series of rhythm sounds on the same time-axis, and 
also for performing display instruction of the operating 
timing for each sound; a step for controlling the sound 
generating means to output at least background sound; 
a step for controlling sound generating means and out- 
putting at least background sound; a step wherein one 
of sound data is selectively instructed for a type of the 
mimic percussion instruments provided correlating to 
each of the plurality of series of rhythm sounds and an 
operating timing thereof, and judging is made whether 
or not the instructed sound data is instructed as operat- 
ing timing within the certain interval; and a step for com- 
paring the operating timing as to the instructed sound 
data with display instruction timing of the operation tim- 
ing, and for evaluating the rhythm input from the offset 
amount thereof. 

[0070] According to these configurations, a plurality 
of series of rhythm sounds are correlated respectively in 
the time-axial direction and displayed, and display 
instruction is performed for the operating timing for each 
sound of multiple mimic percussion instruments; and 
sequential striking input is performed with at least the 
left and right hands for example for rhythm sounds via 
rhythm input detecting means corresponding to multiple 
mimic percussion instruments, while confirming the 
operation timing display instructions thereof, so a 
rhythm-matching game with higher gaming nature is 
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realized, and also, even though staging operation for 
music is performed in a percussion instrument playing 
state closer to reality using at least the right hand and 
left hand for example and further the foot, the rhythm- 
matching game does not become complex/and the s 
game can be carried out relatively easily. Also input 
evaluation can be performed for players making input by 
listening to the background music only. 
[0071] Also, the rhythm input detecting means may 
have an acoustic sensor provided at a portion other w 
than the striking portion of the mimic percussion instru- 
ments. According to the above configuration, the rhythm 
input detecting means can be easily configured using 
an acoustic sensor. " 
[0072] Also, the plurality of the mimic percussion 15 
instruments may consist of a plurality of first mimic per- 
cussion instruments mimicking a drum to beat with a 
stick, and at least one second mimic percussion instru- 
ment for striking input by the foot. According to the 
above configuration, a rhythm-matching game can be 20 
performed ,s a state closer to reality, using the right and 
left hands and further the foot. 

[0073] Further, the display array of each series of 
rhythm sounds displayed by the display control means 
on the display means may match the array of the plural- 25 
ity of mimic percussion instruments 
[0074] Further, the display control means may dis- 
play marks representing mimic percussion instruments 
corresponding to the display area of the respective 
series of rhythm sounds, within the display screen 30 
[0075] According to these configurations, the dis- 
play array for guiding the striking or pedal operation of 
he multiple mimic percussion instruments along the 
time-system is readily viewed. 

TJ? , ^ rther " thG diSplay contral means changes 35 
he display format at the operating timing. According to 

the above configuration, whether the operating timing is 

good or bad is clearly understood in real-time, so the 

player can perform the game at a high level 

[0077] Further, the sound output control means <o 
may output to the sound generating means the sound 
data instructed at the point that input detection has 
been made with the rhythm input detecting means in a 
s ate that the judging means has affirmed, at the oper- 
ating t,ming, and thus emits sound. Also, the sound out- 45 
put control means may output to the sound generating 

attatlZt dat , a inStrUCted 35 the ° peratin 9 timin 9 * 
a state that the judging means has affirmed, at a prede- 
termined point in time', thereby emitting sound 
[0078] Further, the evaluating means may evaluate so 
by accumulating the evaluation value for the offset 
amount of each piece of sound data. Also, the evaluat- 
ing means may set a tolerance range before and after 
the operating timing for each Sound data, and calculate 
score by accumulating addition values set according to 55 
the smallness of the amount of being off within the inner 
and outer sides of the boundary of the tolerance range 
as a re.erence thereof, and subtraction values set 



according to the greatness of the amount of being off at 
the outer side thereof. Though this arrangement is such 
wherein the higher the score is, the higher the skill is 
deemed to be, but an arrangement may be made 
wherein the higher the score is, the lower the skill is 
deemed to be. 

[0079] According to these configurations, sound 
emission output control and rhythm input evaluation is 
performed according to the sound selection contents 
(type of the mimic percussion instrument) and the input 
detection timing thereof, so evaluation can be made 
accurate/ on an evaluation standard, so in the event 
that two take turns to play, the two can compete regard- 
ing the evaluation standard, and the rhythm-matching 
?™ can be en J'°y ed ^ a fair and objective manner 
[0080] Further, the sound data may contain touch 
sounds. In the event that the acoustic sensors serving 
as the rhythm input detecting means do not detect 
on/off m a digital manner but detect striking amounts in 
an analog manner, the sound data can have touch 
intensity. 

[0081] The above configuration gives a greater vari- 
ety of sounds emitted by sound emission instruction 
and the gaming of the rhythm-matching game can be 
carried out at an even higher level. 
[0082] Further, the display control means may com- 
prise graphic storing means for storing notes screen 
data for visually guiding the rhythm input operation by 
the operating means; and graphic control means for 
sequentially updating the notes screen data according 
to the flow of the time-system of the played music piece 
and also for displaying whether or not there has been a 
rnnLT ^ operatin 9 « mi "9 by the rhythm input means. 
[0083] According to the above configuration, sound 
emission instruction is performed with the notes screen 
as a guide, so even a relatively complex played music 
piece can be easily played in the rhythm-matching 
game. Also, misses in. input are displayed on the notes 
screen in real-time, so the player can identify and imme- 
diately correct his/her mistake in real-time, thereby 
allowing the rhythm-matching game to be enjoyed at an 
even higher level. 

[0084] Thus, the staging operation using multiple 
staging operating means for staging input by the player 
comprised of at least a striking operation may be visu- 
ally displayed and instructed to the player following the 
stored contents of the storage means, and sequential 
striking input may be performed with the left and right 
hands for example for staging of music corresponding to 
multiple staging operating means, while confirming the 
operation timing display instructions of the striking oper- 
ation at least, so as to realize a music staging game with 
higher gaming nature, and also, even though staging 
operation for music may be performed in a percussion 
instrument playing state closer to reality using at least 
the right hand and left hand, and further the foot oper- 
ating for the music staging is performed based on visual 
display instructions, so the complexity of the music stag- 
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ing game is lightened, and can be carried out relatively 
easily. 

[0085] Also, according to multiple aspects of the 
present invention, rhythm sounds are each correlated in 
the time-axial direction and displayed, instruction and 5 
display of the operating timing for each sound of the 
multiple mimic percussion instruments is performed, 
and sequential striking input is performed with the left 
and right hands for example for the rhythm sounds via 
the rhythm input detecting means corresponding to mul- w 
tiple mimic percussion instruments, while confirming the 
. . operation timing display instructions thereof, so a 
rhythm-matching game with higher gaming nature is 
realized, and even though rhythm sound input is per- 
formed in a percussion instrument playing state closer is 
to reality using at least the right hand and left hand, and 
further the foot, the complexity of the rhythm-matching 
game is lightened, and can be carried out relatively eas- 
ily. 

[0086] Further, the rhythm input detection means 20 
can be easily configured from an acoustic sensor, and a 
rhythm-matching game can be performed in a percus- 
sion instrument playing state closer to reality using at 
least the right hand and left hand, and further the foot, 
using multiple percussion instruments. 25 
[0087] The display array of each series of rhythm 
sounds may be arranged to match the array of the plu- 
rality of mimic percussion instruments, with marks rep- 
resenting the mimic percussion instruments 
corresponding to the display area of the respective 30 
series of rhythm sounds, so the display array for guiding 
the striking or pedal operation of the mimic percussion 
instruments along the time-system is readily viewed. 
[0088] Further, the various display forms may be 
changed at the operating timing, so that whether the 35 
operating timing is good or bad is clearly understood in 
real-time, and thus the player can perform the game at 2 
a high level. 

[0089] Further, sound output control and rhythm 
input evaluation may be performed according to the' 40 
sound selection contents (type of the mimic percussion 
instrument) and the input detection timing thereof, so 
evaluation can be made accurately on an evaluation 
standard, and this arrangement is particularly advanta- 
geous in the event that two take turns to play, since the 45 
two can compete regarding the evaluation standard, 
and the rhythm- match ing game can be enjoyed in a 
more fair and objective manner. 

[0090] Also, a great variety of sounds may be emit- 
ted by sound emission instruction, so the gaming of the so 
rhythm-matching game can be carried out at an even 
higher level. 

[0091] Further, sound emission instruction may be 
performed with the notes display as a guide, so even a 
relatively complex played music piece can be easily 55 
played in the rhythm-matching game. Also, misses in 
input may be displayed on the notes display in real-time, 
so the player can identify and immediately correct 3. 



his/her mistake in real-time, thereby allowing the 
rhythm-matching game to be enjoyed at an even higher 
level. 

Claims 

1. A music staging game apparatus, comprising: 

a plurality of staging operating means (1A) for 
staging input from a user by at least a striking 
operation; 

a storage means (1B) for storing data regard- 
ing music and staging procedures for said 
music; 

a playing means (1C) for playing said music 
based on the storage contents of said storage 
means (1 B); 

a staging operation instructing means (1 D) for 
visually instructing said player in the staging 
operating using said staging operating means 
(1A), following the storage contents of said 
storage means (1B) in a manner synchronous 
with the progression of the playing by said play- 
ing means (1C); 

a staging effects generating means (1E) for 
generating staging effects corresponding to 
said staging operation; 

an evaluating means (1F) for evaluating said 
staging operation based on the correlation 
between the staging procedures stored by said 
storage means (1 B) and said staging operation 
made by said player; and 
evaluation display means (1G) for displaying 
information according to the evaluation results 
of said evaluating means (1F) to the player. 

A music staging game apparatus according to 
Claim 1 , wherein said staging operation instructing 
means (1D) has a display means (1K), and a dis- 
play control means (1 L) for displaying the staging of 
a plurality of types as to music in a manner respec- 
tively related in the time axial direction, and for vis- 
ually perform operation timing instruction for a 
plurality of types of playing for said music; 

and wherein said evaluating means (1F) has 
judging means (1N) for judging whether or not the 
staging as to said music subjected to staging input 
from said staging operating means (1A) has been 
instructed as operating timing within a certain time 
interval, and a staging input evaluating means (1 P) 
for comparing the operation timing of said staging 
operation means (1A) as to the staging of said 
music instructed as said operation timing with the 
operation timing instruction by said display control 
means (1L), thereby evaluating the staging input 
from this offset amount. 

A music staging game apparatus according to 
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Claim 1 or 2, wherein a sound generating means (3 
4) is provided as said playing means (1C), a sound 
output control means (1M) is provided as said stag- 
mg effects generating means (1E), and the staging 
as to said music is comprised of a series of rhythm 
sounds: 

and wherein said staging operating means 
(1A) consists of a plurality of mimic percussion 
instruments (1H) provided each correlating to said 
plurality of series of rhythm sounds, and a rhythm 
input detecting means (1 J) for receiving the striking 
operating to said mimic percussion instruments 
' ' and Meeting the operation timing of the corre- 
sponding rhythm sound. 

A music staging game apparatus according to 
Claim 3, wherein said rhythm input detecting 
means (1J) has an acoustic sensor provided at a 
portion other than the striking portion of said mimic 
percussion instruments (1 H). 



w 



A music staging game apparatus according to 
Claim 3 or 4, wherein said plurality of said mimic 
percussion instruments (1H) consist of a plurality of 
first mimic percussion instruments mimicking a 
drum (7) to beat with a stick, and at least one sec- 
ond m.mic percussion instrument for striking input 
by the foot. K 



10. A mus.c staging game apparatus according to any 
one of Claims 3 to 9, wherein said sound output 
control means (1 M) outputs to said sound generat- 
ing means (3, 4) sound data instructed as said 
operating timing in a state that said judging means 
(1N) has affirmed, at a predetermined point in time. 

11. A music staging game apparatus according to any 
one of Claims 1 to 10, wherein said evaluating 
means (1F) evaluates by accumulating the evalua- 
tion value for said offset amount of each piece of 
sound data. 

12. A music staging game apparatus according to any 
one of Claims 1 to 11, wherein said evaluating 
means (1 F) sets a tolerance range before and after 
the operating timing for each sound data, and cal- 
culates score by accumulating addition values set 
according to the smallness of the amount of being 
20 off wrthin the inner side of the boundary of the toler- 
ance range as a reference thereof, and subtraction 
values set according to the greatness of the amount 
of being off at the outer side thereof. 

3. A music staging game apparatus according to any 
one of Claims 3 to 1 2, wherein said sound data con- 
tains touch sounds . 
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• A music staging game apparatus according to any 
one of Claims 3 to 5, wherein the display array of 
each series of rhythm sounds displayed by said dis- 
play control means (1 L) on said display means (1 K) 
matches the array of the plurality of mimic percus- 
sion instruments (7, 8, 9, 10, 11, 12). 

A music staging game apparatus according to any 
one of Claims 3 to 6, wherein said display control 
means (1L) displays marks (58) representing mimic 
percussion instruments (7, 8, 9, 10, 11, 1 ^corre- 
sponding to the display area of the respective 
series of rhythm sounds, within the display screen 
(5o). 

A music staging game apparatus according to any 
one of Claims 2 to 7, wherein said display control 
means (1L) changes the display format at said 
operating timing. 

A music staging game apparatus according to 
Uaim 3 to 8, wherein said sound output control 
means (1M) outputs to said sound generating 
means (3, 4) the sound data instructed at the point 
that input detection has been made with said 
rhythm lnput detecting means (1J) in a state that 55 
said judging means (IN) has affirmed, at said oper- 
ating timing, and thus emits sound. 
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14. A music staging game apparatus according to any 
one of Claims 3 to 13, wherein said display control 
means (1 L) comprises: 

graphic storing means (47) for storing notes 
screen data for visually guiding the rhythm 
input operation by said operating means (1A); 
and graphic control means (48) for sequentially 
updating said notes screen data according to 
the flow of the time-system of the played music 
piece, and also for displaying whether or not 
there has been a miss in the operation timing 
by said rhythm input means (1J). 

A music staging game method, comprising: 

a step for displaying on a display means (1 K) a 
plurality of series of rhythm sounds, each cor- 
related respectively in the time-axial direction 
and for performing display instruction of the 
operating timing for each sound; 
a step for controlling sound generating 
means(3, 4) to output at least background 
sound; 

a step wherein one of sound data is selectively 
instructed for a type of the mimic percussion 
instruments (7, 8, 9, 10, 11, 12) provided corre- 
lating to each of said plurality of series of 
rhythm sounds and an operating timing thereof 
and judging is made whether or not the 
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instructed sound data is instructed as operat- 
ing timing within the certain interval; and 
a step for comparing the operating timing as to 
said instructed sound data with display instruc- 
tion timing of said operating timing, and for 5 
evaluating the rhythm input from the offset 
amount thereof. 

A readable storage medium wherein are recorded 
control programs for executing the following steps: w 

a step for displaying on a display means (1 K) a 
plurality of series of rhythm sounds, each cor- 
related respectively in the time-axial direction, 
and also for performing display instruction of 15 
the operating timing for each sound; 
a step for controlling sound generating means 
(3, 4) to output at least background sound; 
a step wherein one of sound data is selectively 
instructed for a type of the mimic percussion 20 
instruments (7, 8, 9, 1 0, 1 1 , 12) provided corre- 
lating to each of said plurality of series of 
rhythm sounds and an operating timing thereof, 
and judging is made whether or not the 
instructed sound data is instructed as operat- 25 
ing timing within the certain interval; and 
a step for comparing the operating timing as to 
said instructed sound data with display instruc- 
tion timing of said operating timing, and for 
evaluating the rhythm input from the offset 30 
amount thereof. 
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FIG. 7 
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